Do neural networks represent a shift in coding? Tesla's director of AI Andrej Karpathy in his note on Software 2.0 has coined this new term which emphasises a shift in developing and writing software. His take on the question is that training neural nets and predicting using them involves a new way of thinking of software. The earlier methodology, according to Karpathy, involved writing code, say, in Python and putting it in production. However, when it comes to training neural nets -- the developer has to set up a framework for the neural net to properly "learn" and repeatedly feed examples through it of what the correct answer is to "teach" it.